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ON ASYMPTOTICS OF EIGENVECTORS OF LARGE SAMPLE 
COVARIANCE MATRIX 
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University of Science and Technology of China 

Let {Xij}, i,j = be a double array of i.i.d. complex ran- 
dom variables with EXu = 0, E\Xn | 2 = 1 and E\Xn | 4 < oo, and let 
A n = iT„ 1/2 J„i;T„ 1/2 , where T^ 2 is the square root of a nonnega- 
tive definite matrix T n and X n is the n x N matrix of the upper-left 
corner of the double array. The matrix A„ can be considered as a 
sample covariance matrix of an i.i.d. sample from a population with 
mean zero and covariance matrix T n , or as a multivariate F matrix 
if T n is the inverse of another sample covariance matrix. To inves- 
tigate the limiting behavior of the eigenvectors of A n , a new form 
of empirical spectral distribution is defined with weights defined by 
eigenvectors and it is then shown that this has the same limiting 
spectral distribution as the empirical spectral distribution defined by 
equal weights. Moreover, if {Xij} and T n are either real or complex 
and some additional moment assumptions are made then linear spec- 
tral statistics defined by the eigenvectors of A n are proved to have 
Gaussian limits, which suggests that the eigenvector matrix of A n is 
nearly Haar distributed when T n is a multiple of the identity matrix, 
an easy consequence for a Wishart matrix. 

1. Introduction. Let X n = (Xij) be an n x N matrix of i.i.d. complex 
random variables and let T n be an n x n nonnegative definite Hermitian 
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matrix with a square root T n ■ In this paper, we shall consider the matrix 
A n = jjT^ 2 X n X*T^ 2 ■ If T n is nonrandom, then A n can be considered as a 
sample covariance matrix of a sample drawn from a population with the same 

1/2 

distribution as T n X. i, where X. 5 i = (Xn, . . . , X n \)' . If T n is an inverse of 
another sample covariance matrix, then the multivariate F matrix can be 
considered as a special case of the matrix A n . 

In this paper, we consider the case where both dimension n and sample 
size ./V are large. Bai and Silverstein [7] gave an example demonstrating the 
considerable difference between the case where n is fixed and that where 
n increases with N proportionally. When T n = I, A n reduces to the usual 
sample covariance matrix of N n-dimensional random vectors with mean 
and covariance matrix /. An important statistic in multivariate analysis is 

N 

W n = HdetA n ) = J2H^), 

3=1 

where Xj, j = 1, . . . ,n, are the eigenvalues of A n . When n is fixed, by taking 
a Taylor expression of ln(l + x), one can easily prove that 

Wn^N^EX^ -1). 

It appears that when n is fixed, this distribution can be used to test the 
hypothesis of variance homogeneity. However, it is not the case when n 
increases as [cN] (the integer part of cN) with c£ (0,1). Using results of 
the limiting spectral distribution of A n (see [12] or [1]), one can show that 
with probability one that 

-W n — - ln(l - c) - 1 = die) < 0, 
n c 

which implies that 

W n ~ d{c)^f~Nn^> -co. 

More precisely, the distribution of W n shaft to left quickly when n increases 
as n ~ cN. Figure 1 gives the kernel density estimates using 1000 realizations 
of W n for N = 20, 100, 200 and 500 with n = 0.2N. Figures 2 and 3 give the 

kernel density estimates of \f^W n for the cases n = 5 and n = 10 with 
N = 50. These figures clearly show that the distribution of W n cannot be 
approximated by a centered normal distribution even if the ratio c is as 
small as 0.1. 

This phenomenon motivates the development of the theory of spectral 
analysis of large-dimensional random matrices which is simply called random 
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Fig. 1. Density ofW„ under different sample sizes, c — 0.2. 



matrix theory (RMT) . In this theory, for a square matrix A of real eigenval- 
ues, its empirical spectral distribution (ESD) F A is defined as the empirical 
distribution generated by its eigenvalues. The limiting properties of the ESD 
of sample covariance matrices have been intensively investigated in the lit- 
erature and the reader is referred to [[1, 5, 6, 7, 11, 12, 13, 17, 20, 21, 23]]. 

An important mathematical tool in RMT is the Stieltjes transform, which 
is defined by 

m G ( z ) = f —L_ dG(X), z G C + = {z E C, Qz > 0}, 
J X - z 

for any distribution function G{x). It is well known that G n —> G if and only 
if niG n (z) — > mc(z), for all z G C + . 
In [13], it is assumed that: 

(i) for all n,i,j, Xij are independently and identically distributed with 
EXij = and E\Xij\ 2 = l; 

(ii) F Tn — > H, a proper distribution function; 
(hi) jf — >c>0asn— > co. 

It is then proved that, with probability 1, F An converges to a nonrandom 
distribution function F C,H whose Stieltjes transform m(z) = m F c,H(z), for 
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Fig. 2. Probability density of y/ ^W n (n = 5,N = 50) 



each z S C + , is the unique solution in C + of the equation 

1 



(1.1) 



m{z) 



t(l — c — azm) — z 



dH(t). 



Let .A n = jfX*T n X]y . The spectrum of A n differs from that of A n only by 
\n — N\ zero eigenvalues. Hence, we have 



n , 



n 



It then follows that 



1 — n/iV n 

(1.2) m n (z) ="i F A n (z) = + ^m F A„(z) 



and, correspondingly for their limits, 
(1.3) m(z) = m F c,H (z) 



+ cm(z), 



where F_ C,H is the limiting empirical distribution function of A n . 
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Fig. 3. Probability density of y^W n (n = 10, N = 50) . 

Using this notation, equation (1.1) can be converted to equation (1.4) for 
m(z). That is, m(z) is the unique solution in C + of the equation 

(1.4) m = -[z-c — . 

V ; — \ J 1 + tm) 

From this equation, the inverse function has the explicit form 

1 ftdH(t) 

(1.5 z = + c / ^. 

m 7 1 + tm 

The limiting properties of the eigenvalues of A n have been intensively inves- 
tigated in the literature. Among others, we shall now briefly mention some 
remarkable ones. Yin, Bai and Krishnaiah [22] established the limiting value 
of the largest eigenvalue, while Bai and Yin [2] employed a unified approach 
to obtain the limiting value for the smallest and largest eigenvalues of A n 
when T/v = I. A breakthrough on the convergence rate of the ESD of a 
sample covariance matrix was made in [3] and [4]. In [5], it is shown that, 
with probability 1, no eigenvalues of A n appear in any interval [a, b] which 
is contained in an open interval outside the supports of F C " ,H " for all large 
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N under the condition of finite 4th moment (here, c n = n/N and H n is the 
ESD of T n ). 

However, relatively less work has been done on the limiting behavior of 
eigenvectors of A n . Some results on this aspect can be found in [[14, 15, 16]]. 
That more attention has been paid to the ESD of the sample covariance 
matrix may be due to the origins of RMT, which lie with quantum mechanics 
(QM), where the eigenvalues of large-dimensional random matrices are used 
to describe energy levels of particles. With the application of RMT to many 
other areas, such as statistics, wireless communications, — for example, the 
CDMA (code division multiple access) systems and MIMO (multiple input 
multiple output) systems, finance and economics, and so on, the importance 
of the limiting behavior of eigenvectors has been gradually recognized. For 
example, in signal processing, for signals received by linearly spaced sensors, 
the estimates of the directions of arrivals (DOA) are based on the noise 
eigenspace. In principal component analysis or factor analysis, the directions 
of the principal components are the eigenvectors corresponding to the largest 
eigenvalues. 

Now, let us consider another example of the application of eigenvectors 
of a large covariance matrix A n which is important in wireless communi- 
cations. Consider transmission methods in wireless systems. In a direct se- 
quence CDMA system, the discrete-time model for a synchronous systems 
is formulated as 

K 

r = Yl bkSk + w ' 

k=l 

where &&(£ C) and Sfc(€ C N ) are the transmitted data symbols and signature 
sequence of the user k, respectively, and w is an A^-dimensional background 
Gaussian noise of i.i.d. variables with mean zero and variance a 2 . The goal 
is to demodulate the transmitted for each user. In this case, the per- 
formance measure is defined as the signal-to-interference ratio (SIR) of the 
estimates. In a large network, since the number of users is very large, it is 
reasonable to assume that K is proportional to N. That is, one can assume 
that their ratio remains constant when both K and ./V tend to infinity. Thus, 
it is feasible to apply the theory of large-dimensional random matrices to 
wireless communications and, indeed, there has already accumulated a fruit- 
ful literature in this direction (see, e.g., [18] and [19], among others). Eldar 
and Chen [10] derived an expression of SIR for the decorrelator receiver in 
terms of eigenvectors and eigenvalues of random matrices and then analyzed 
the asymptotics of the SIR (see [10] for details). 

Our research is motivated by the fact that the matrix of eigenvectors 
(eigenmatrix for short) of the Wishart matrix has the Haar distribution, 
that is, the uniform distribution over the group of unitary matrices (or or- 
thogonal matrices in the real case). It is conceivable that the eigenmatrix 
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of a large sample covariance matrix should be "asymptotically Haar dis- 
tributed." However, we are facing a problem on how to formulate the ter- 
minology "asymptotically Haar distributed" because the dimensions of the 
eigenmatrices are increasing. In this paper, we shall adopt the method of Sil- 
verstein [14, 15]. If U has a Haar measure over the orthogonal matrices, then 
for any unit vector x E M n , y = Ux = . . . , y n )' has a uniform distribution 
over the unit sphere S n = {x E M n ; ||x|| = 1}. If z = . . . , z n )' ~ iV(0, I n ), 
then y has the same distribution as z/||z||. 

Now, define a stochastic process Y n (t) in the space D(0, 1) by 



where [a] denotes the greatest integer < a. From the second equality, it is 
easy to see that Y n (t) converges to a Brownian bridge (BB) B(t) when n 
converges to infinity. Thus we are interested in whether the same is true for 
general sample covariance matrices. 

Let U n A n U* denote the spectral decomposition of A n , where A n = diag(Ai, 
A2, • • • , A n ) and U n = (tty) is a unitary matrix consisting of the orthonormal 
eigenvectors of A n . Assume that x n E C n , ||x n || = 1, is an arbitrary nonran- 
dom unit vector and that y = (yi, 1/2, ■ ■ ■ , y n )* = U*x n . We define a stochastic 
process by way of (1.6). If U n is "asymptotically Haar distributed," then y 
should be "asymptotically uniformly distributed" over the unit sphere and 
Y n (t) should tend to a BB. Our main goal is to examine the limiting prop- 
erties of the vector y through the stochastic process Y n (t). 

For ease of application of RMT, we make a time transformation in Y n (t), 



where F n is the ESD of the matrix A n . If the distribution of U n is close 
to Haar, then X n {x) should approximate B(F C,H (x)), where F C,H is the 
limiting spectral distribution of A n . 

We define a new empirical distribution function based on eigenvectors and 
eigenvalues: 




(1.6) 




X n (x) = Y n (F A "(x)) 



1 1 



(1.7) 




^bi| 2 /(Ai<x). 



i=i 



Recall that the ESD of A n is 



F A "(x) = -V/(A i <x). 
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It then follows that 

X n (x) = ^{Ft(x)-F A -(x)). 

The investigation of Y n (t) is then converted to one concerning the difference 
F An (x) — F An (x) of the two empirical distributions. 

It is obvious that F 1 n (x) is a random probability distribution function 
and that its Stieltjes transform is given by 

(1.8) m p A n (z) =x* n (A n - z/)~ 1 x n . 

As we have seen, the difference between F An (x) and F An {x) is only in 
their different weights on the eigenvalues of A n . However, it will be proven 
that although these two empirical distributions have different weights, they 
have the same limit; this is included in Theorem 1.1 below. 

To investigate the convergence of X n (x), we consider its linear functional, 
which is defined as 

x n(g) = J g(x)dx n (x), 

where g is a bounded continuous function. It turns out that 

n -i n 

£|y;b(^)--£<7(A;) 
■3=1 n j=l J 

J g{x) dF^ n (x) - J g{x)dF An (x) . 

Proving the convergence of X n {g) under general conditions is difficult. Fol- 
lowing an idea of [7], we shall prove the central limit theorem (CLT) for those 
g which are analytic over the support of the limiting spectral distribution of 
A n . To this end, let 

G n (x) = Vn(F a -(x) - F Cn ' Hn (x)), 

where c n = jjj and where F Cn,Hn (x) denotes the limiting distribution by 
substituting c n for c and H n for H in F C,H . 

The main results of this paper are formulated in the following three the- 
orems. 

Theorem 1. Suppose that: 

(1) for each n, Xij = X^,i,j = 1,2, ... , are i.i.d. complex random vari- 
ables with EXu = 0,-E|Xn| 2 = 1 and ElXu^ < oo; 

(2) x n GCy = {xGC n ,||x||=l} and li m?woo = c G (0, oo); 
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(3) T n is nonrandom Hermitian nonnegative definite with its spectral 

norm bounded in n, with H n = F T "-^H a proper distribution function and 
with x* (T n — z/) _1 x n — > TTipH (z) , where m F H(z) denotes the Stieltjes trans- 
form of H(t). It then follows that 

Ff"(x)^F c ' H (x) a.s. 

Remark 1. The condition x*(T n — z/) _1 x n — > nipH (z) is critical for our 
Theorem 1 as well as for the main theorems which we give later. At first, 
we indicate that if T n = bl for some positive constant b or, more generally, 
A m ax(r„) - A min (T n ) ->■ 0, then the condition x*(T n - ziy 1 x n -> m FH (z) 
holds uniformly for all x n 6 C". 

We also note that this condition does not require T n to be a multiple of 
an identity. As an application of this remark, one sees that the eigenma- 
trix of a sample covariance matrix transforms x n to a unit vector whose 
entries' absolute values are close to 1/y/N. Consequently, the condition 
x* (T n — z/)~ 1 x n — > m F n(z) holds when T n is the inverse of another sample 
covariance matrix which is independent of X n . Therefore, the multivariate 
F matrix satisfies Theorem 1. 

In general, the condition may not hold for all x n £ C™. However, there 
always exist some x n £ C™ such that this condition holds, say x n = (ui + • • • + 
u n)/ v^j where ui, . . . , u n are the orthonormal eigenvectors of the spectral 
decomposition of T n . 

Applying Theorem 1, we get the following interesting results. 

Corollary 1. Let (A™)u,m= 1,2, denote the ith diagonal ele- 
ments of matrices A™ . Under the conditions of Theorem 1 for x n = e n i, 
it follows that for any fixed m, 



lim 

n— >oo 



(A™) u -J x m dF c > H (x) 



a.s., 

where e n j is the n-vector with ith element 1 and all others 0. 



Remark 2. If T n = bl for some positive constant b or, more generally, 
Amax(Tri) — A m i n (T r j) — > 0, then there is a better result, that is, 



(1.9) lim max 

n— >oo i 



(A™) u -Jx m dF c ' H ( x ) 



a.s. 



[The corollary follows easily from Theorem 1. The uniform convergence of 
(1.9) follows from the uniform convergence of condition (3) of Theorem 1 
and by careful checking of the proof of Theorem 1.] 



More generally, we have the following: 
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Corollary 2. If f(x) is a bounded function and the assumptions of 
Theorem 1 are satisfied, then 

n 1 n 

£|yfi/( A ,)--E/( A ,)- <*■-■ 



Remark 3. The proof of the above corollaries are immediate. Applying 
Corollary 2, Theorem 1 of [10] can be extended to a more general case 
without difficulty. 

Theorem 2. In addition to the conditions of Theorem 1, we further 
assume that: 

(4) gx,...,gj~ are defined and analytic on an open region T> of the complex 
plane which contains the real interval 



(1.10) 

and 
(5) 



liminf A^ n / (0 ,i)(c)(l - yfcf, limsup A^" ax (l + yfcf 



sup v N 



x* n (m F c n ,H n (z)T n + I) 1 x n - J 



(z)t+l 



dH n {t) 



as n — > oo . 

Then the following conclusions hold: 
(a) The random vectors 



9i(x)dG n (x),..., / g k {x)dG n {x) 



(1.11) 



form a tight sequence. 

(b) // X\\ and T n are real and EXf-^ = 3, then the above random vec- 
tor converges weakly to a Gaussian vector X gi , . . . , X gk with mean zero and 
covariance function 



(1.12) 



Cov(X gi ,X 92 ) 
1 

~~2^2 



Ci JC 2 



9i{zi)g 2 {z2) 



(z 2 m(z 2 ) - zim{zi)f 



■ dz\ dz 2 ■ 



c 2 z 1 z 2 (z 2 -zx){m{z 2 ) -m(zi)) 

The contours C\ and C 2 in the above equation are disjoint, are both contained 
in the analytic region for the functions {gi, ■ ■ ■ ,gk) and both enclose the 
support of F Cn ' Hn for all large n. 
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(c) If Xn is complex with EX\ X = and E\Xii\ 4 = 2, then the conclu- 
sions (a) and (b) still hold, but the covariance function reduces to half of 
the quantity given in (1.12). 

Remark 4. If T n = bl for some positive constant b or, more generally, 
Vn(^ma,x{T n ) — A m i n (T n )) — > 0, then condition (5) holds uniformly for all 

x n e cy. 

Remark 5. Indeed, we can also establish the central limit theorem for 
X n (g) according to Theorem 1.1 of [7] and Theorem 2. Beside Theorem 2, 
which holds for more general functions g(x), the following theorem reveals 
more similarities between the process Y n {t) and the BB. 

Theorem 3. Beside the assumptions of Theorem 2, if H(x) satisfies 

(113) f dH{t) r dH(t) r dH{t) _ Q 

J (l + tm(z 1 ))(l+tm(z 2 )) J (l + tm( Zl ))J (l+tm(z 2 )) 

then all results of Theorem 2 remain true. Moreover, formula (1-12) can be 
simplified to 



(1.14) 



Cov(X gi ,X g2 ) = - c (J gi (x)g 2 (x) dF c,H (x) 



g l {x 1 )dF^ H {x l ) J g 2 (x2)dF c > H (x 2 )y 



Remark 6. Obviously, (1.13) holds when T n = bl. Actually, (1.13) holds 
if and only if H(x) is a degenerate distribution. To see this, one need only 
choose z 2 to be the complex conjugate of Z\. 

Remark 7. Theorem 3 extends the theorem of Silverstein [15]. First, 
one sees that the rth moment of F^ n (x) is x* n A! n x n ^ which is a special case 
with g{x) = x r . Then applying Theorem 3 with T n = bl and combining with 
Theorem 1.1 of [7], one can obtain the sufficient part of (a) in the theorem 
of Silverstein [15]. Actually, for T n = 1, formula (1-12) can be simplified to 

Cov(X gi ,X g2 ) = -([ 9i{x)g 2 (x)dF c (x) 

(1.15) 



5i(xi)dF c (xi) J g 2 (x 2 ) dF c (x 2 ) ), 
where F c {x) is a special case of F c ' H (x), as T n = I. 



12 



Z. D. BAI, B. Q. MIAO AND G. M. PAN 



The organization of the rest of the paper is as follows. In the next section, 
we complete the proof of Theorem 1. The proof of Theorem 2 is converted 
to an intermediate Lemma 2, given in Section 3. Sections 4 and 5 contain 
the proof of Lemma 2. Theorem 3 and some comparisons with the results of 
[15] are given in Section 6. A truncation lemma (Lemma 4) is postponed to 
Section 7. 



2. Proof of Theorem 1. Without loss of generality, we assume that ||T n || < 
1, where || • || denotes the spectral norm on the matrices, that is, their largest 
singular values. Throughout this paper, K denotes a universal constant 
which may take different values at different appearances. 



Lemma 1. (Lemma 2.7 in [5]). Let X = (X\, . . . , X n ), where Xj's are 
i.i.d. complex random variables with zero mean and unit variance. Let B be 
a deterministic n x n complex matrix. Then for any p>2, we have 

E\X*BX - tiB\ p < K p {(E\X l \ A txBB*ff 2 + E\X l \ 2P tv(BB*f' 2 ). 

For K > 0, let X {i = Xy/flXyl < K) - EX^I^X^ < K) and A n = 
jfT^ 2 X n X*Tn , where X n = (Xij). Let v = > 0. Since Xij — X^ = 
XijlQXijl > K) - EXijl^Xijl > K) and \\{A n - zl)~ l \\ is bounded by ±, 
by Theorem 3.1 in [22], we have 

l x n(^-™ ~~ x i — x n(^n — Z I) x n| 

<\\{A n -zI)- x -{A n -zI)- 1 \\ 

< \\(A n - ziy'WUAn - A n )\\\\(A n - zl)- l \\ 

~ iVV ~ II + H^HH^n ~~ ^nll) 



- {1 + f )2 [E 1 / 2 \X 11 - XnWE^lXnl 2 + E^Xu] 3 )] 
< 2{1+ f )2 E^lXnfldXnly K). 



a.s. 



The above bound can be made arbitrarily small by choosing K sufficiently 
large. Since \\m. n _ i(X> E\Xn\ 2 = 1, the rescaling of Xy can be dealt with 
similarly. Hence, in the sequel, it is enough to assume that \Xi~ \ < K, EXu = 
and -E|Xq| 2 = 1 (for simplicity, suppressing all super- and subscripts on 
the variables X^). 

Next, we will show that 

(2.1) x* n (A n - zl)- 1 ^ - x* n E(A n - zl)- 1 ^ a.s. 
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Let Sj denote the jth column of -^=Tn X U ) A{z) = A n — zl, Aj(z) = A(z) — 

SjSj, 

aj(z) = s*A- l {z)y. n y? n (Em n {z)T n + 7) _1 Sj 

- ^l{Em n {z)T n + iy^Aj 1 ^, 
t 3 (z)=B* j Aj 1 (z)B j -^trT n Aj\z), 

7j = B * j Aj 1 (z)x n y^Aj 1 (z)a j - ^<Aj x (z)T n Af (z)x n 



and 



N 

1 



l + s*A- L (z)sj JK l + N~HiT n Aj L (z) 

Noting that < \z\/v and ||t4J 1 (z)|| < l/v, by Lemma 1, we have 

(2.2) E\ S *Aj\z)x n ^Aj\z) Sj \ r = 0^, E\^z)\ r = O 

Define the a-field T 3 = <r(si, . . . , Sj), let Ej(-) denote conditional expecta- 
tion given the u-field J-j and let Eq(-) denote the unconditional expectation. 
Note that 

N 

= Y J <E j A- l {z)* n - x; J B J _i^ 1 (z)x n 

(2.3) j=i 

N 

= Y,<E J {A-\z)-A-\z))K n -K* n E^ 1 {A-\z)-^\z))K n 

3=1 
N 

= - J2(Ej - E^ 1 )P j (z) S *Aj\z) XnX * n Aj\z)s j 

3=1 
N 

3=1 



(Ej - E j _ 1 )s*Aj 1 (z) W * n Aj'(z)s j P j (z)b j (z)C j (z). 



By the fact that |- — - ii — | < ^ and use of the Burkholder inequality, 
(2.2) and the martingale expression (2.3), we have 
E\** n {A n - ziy l * n - x* n E{A n - ziy 1 *^ 
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<E 



N 



X^-iKiSj - E j ^)/3 j (z)s*Aj\z)^Aj 1 (z)s j 
■3=1 



r/2 



N 



+ E J2\(Ej- E^ 1 )l3 j {z)s*A-\z)^ n A-\z)s 3 
i=i 



< E 



■ N K \ I 

■3=1 

+ ^-L^ J E|s^- 1 (z)x n x;A- 1 (z)s J f 

3=1 

<i^[iV- r / 2 +Af- r+1 ]. 

Thus (2.1) follows from Borel-Cantelli lemma, by taking r > 2. 
Write 

A 7 " 

- {-zEm n (z)T n - zl) = Y. s i s *j ~ {-zEm n (z))T n . 

3=1 



Using the identities 

and 
(2.4) 



s*A- 1 (z) = /3 J (z)s*AT 1 (z) 



iV 



3=1 



(see (2.2) of [13]), we obtain 

£ , A~ 1 (z) - {-zEm n {z)T n - zl)' 1 



(zEm n (z)T n + zl) 1 E 



N 



J^SjS* - {-zEm n {z))T n A-\z) 
lj=i 



N 



3=1 



(% Ii (^„ + /)" 1 s J s*i: 1 (z) 

- ^(£m n (*)T n + J)" 1 !^" 1 ^) 

Multiplying by x* on the left and x n on the right, we have 
^* l EA~ 1 (z)y. n - x* n (-zEm n (z)T n - zl)~ l y. n 
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(2.5) 



N-Ef3 1 {z) 



s^Al l {z)x r X n {Ern n (z)T ri + I) l Sl 

- ^K(Em n {z)T n + I)- l T n EA^{z)^ n 



where 



A 



N 



5i+ 5 2 + S s 



81 = —Ep l (z)ai(z), 

8 2 = -E{5 x {z)y? r XErn n (z)T n + iy x T n (A\ x (z) - ^" 1 (z))x n , 

8 3 = -Ep 1 (z)^* n (Em n (z)T n + fj^T^A' 1 (z) - EA~ 1 (z))x r , 



Similar to (2.2), by Lemma 1, for r > 2, we have 



1 



E\ aj (z)\ r = — 



N' 



Therefore, 



Sl = -^£&i(z)/3i(z)6(^)ai(z) = 0{N~ Z / 2 ). 



(2.6) 
It follows that 

\8 2 \ = jj\E(3l(z)x* n (Em n (z)T n + ^TnA^^s^A^ 1 {z)^ 

(2.7) < K(\E\x* n (Em n (z)T n + I)- 1 T n A^(z)s l \ 2 E\s* 1 A^ 1 (z)x n \ 2 ) 1/2 
= 0(N~ 1 ) 



and 



(2.8) 



|5 3 | = ^Efciz^iz^iz^liEm^Tn + I)- 1 

xT n (A- 1 (z)-EA- 1 (z))x n \ 
< K(E\^(z)\ 2 E\^ n (Em n (z)T n + 

xT n (A- 1 (z)-EA' 1 (z))x n \ 2 ) 1/2 

= o(N~^ 2 ), 



where to estimate the second factor, we need to use the martingale decom- 
position of A~ 1 (z) - EA~ l (z). 
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Combining the above three results and (2.5), we conclude that 

(2.9) x* n EA-\z)x n - X * n (-zEm n (z)T n - zl)' 1 ^ 0. 

In [13], it is proved that, under the conditions of Theorem 1, Em n (z) 
m(z), which is the solution of equation (1.2), and we then conclude that 

x* n EA~ 1 (z)^ n - x* n (-zm(z)T n - z/) _1 x n -> 0. 

By condition (3) of Theorem 1, we finally obtain that 

dH(t) 



which completes the proof of Theorem 1. 



-zmt — z ' 



3. An intermediate lemma. In the sequel, we will follow the work of 
Bai and Silverstein [7]. To complete the proof of Theorem 2, we need an 
intermediate lemma. 

Write 



M n (z) = VN(m F A n (z) - m F c n ,H n (z)), 



which is defined on a contour C in the complex plane, described as follows. 
Let u r be a number which is greater than the right endpoint of interval 
(1.10) and let u\ be a negative number if the left endpoint of interval (1.10) 
is zero, otherwise let u\ £ (0, liminf n A m " n /(o,i) ( c )(l ~~ V^) 2 )- Let vq > be 
arbitrary. Define 

C u = {u + iv :u£ [ui,u r ]}. 

Then the contour 

C = C u U {ui + iv : v G [0, vo]} U {u r + iv : v G [0, vq]} 

Ujtheir symmetric parts below the real axis}. 

Under the conditions of Theorem 2, for later use, we may select the contour 
C in the region on which the functions g are analytic. 

As in [7], due to technical difficulties, we will consider M*(z), a truncated 
version of M n (z). Choose a sequence of positive numbers {5 n } such that for 
0<p< 1, 

(3.1) M0, S n >n~P. 

Write 

q = f {ui +iv :v £ [?i _1 (5 n ,vo]}, if ui > 0, 
1 \{ui +iv:ve [0,v ]}, iiui<0, 
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M*(z) 



and 

C r = {u r + id:d6 [n~ 1 5 n , vq]}. 
Let Co = C u U Ci U C r . Now, for z = u + iv, we can define the process 

M n (z), 

if z G Co U Coj 

nv + 5 nilir . . _•, . ^ n — nv . . 

— — M n (u r + m 5 n ) H — M n [u r -in M n ), 

ifu = n r , d£ [— n _1 5 n , n _1 5 n ], 

— M n {ui+in o n ) H — M n (ui-in L 6 n ), 

2d n 2d n 

i£u = ui>0, vE[—n S n ,n 8 n ]. 

M*(z) can be viewed as a random element in the metric space C(C,IR 2 ) of 
continuous functions from C to R 2 . We shall prove the following lemma. 

Lemma 2. Under the assumptions of Theorem 1 and assumptions (4) 
and (5) o/ Theorem 2, M*(z) forms a tight sequence on C. Furthermore, 
when the conditions in (b) and (c) of Theorem 2 on In hold, for z G C, 
M*(z) converges to a Gaussian process M(-) wra'ta zero mean and for Z\,zi € 
C, under the assumptions in (b), 

2(z 2 m(2!2) - .zim("Zi)) 2 



(3.2) Cov(M(zi),M(z 2 )) 



C 2 Zl ^2(^2 - ^l)(m(^2) : 



lo/iifc under the assumptions in (c), iae covariance function similar to (3.2) 
«s i/ie half of the value of (3.2). 

Similar to the approach of [7], to prove Theorem 2, it suffices to prove 
Lemma 2. Before proceeding with the detailed proof of the lemma, we need 
to truncate, recentralize and renormalize the variables Xij. However, those 
procedures are purely technical (and tedious), thus we shall postpone then to 
the last section of the paper. Now, according to Lemma 4, we further assume 
that the underlying variables satisfy the following additional conditions: 

\Xij\<e n n xl ^, EX 11 = 0, E\X XX \ 2 = \, £|X n | 4 <oo 

and 

£|X n | 4 = 3 + o(l), 

if assumption (b) of Theorem 2 is satisfied, 
EXl x = o(n- x l\ £|X n | 4 = 2 + (l), 

if assumption (c) of Theorem 2 is satisfied. 

Here, e n is a sequence of positive numbers which converges to zero. 
The proof of Lemma 2 will be given in the next two sections. 
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4. Convergence in finite dimensions. For z £ Co, let 

M\ (z) = (m F A n (z) - ErripAn (z)) 

and 

M 2 (z) = y/N(Em F A n (z) - m Fcn ,H n (z)). 

Then 

M n (z) = Ml{z) + Ml(z). 

In this section for any positive integer r and complex numbers a±, . . . ,a r , 
we will show that 

r 

i=i 

converges in distribution to a Gaussian random variable and will derive the 
covariance function (3.2). To this end, we employ the notation introduced 
in Section 2. 

Before proceeding with the proofs, we first recall some known facts and 
results. 

1. (See [7].) Let Y = (Yi, . . . , Y n ), where Yj's are i.i.d. complex random 
variables with mean zero and variance 1. Let A = (aij) nxn and B = (bij) nxn 
be complex matrices. Then the following identity holds: 

E(Y*AY - tvA)(Y*BY - trS) 

= (E\Y 1 \ 4 - \EY?\ 2 - 2) ^ a u bii + \EY?\ 2 tr AB T + tr AB. 



i=l 



2. (See Theorem 35.12 of [9]. 



Lemma 3. Suppose that for each n, Y n \,Y n 2, . . . , Y nTn is a real martingale 
difference sequence with respect to the increasing a-field {F n j} having second 
moments. If, as n->oo, we have 

(i) Y, E ( Y nj\^-i)^a 2 , 

where a 2 is a positive constant and for each e > 0, 

(") E s ( y nV(|y„,|> £) )-0, 
i=i 

then 

r n 

Y,Y nj ^N(0,a 2 ). 

3=1 
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3. Some simple results follow by using the truncation and centralization 
steps described in Lemma 4 given in the Appendix: 



(4.2) 



£|s^Csi - N- 1 tvT n C\ p < K p \\C\\ p (e 2 n p - 4 N- p / 2 + N~ p l 2 ) 



< K p \\C\\ p N~ p l 2 , 

(4.3) E\s\C W * n D Sl - N~ 1 x.lDT n Cx. n \ p < K p \\C\\ p \\D\\ p e 2p - 4 N- p / 2 -\ 

(4.4) E\ S lC W * n D Sl \ p < K p \\C\\ p \\D\\ p e 2p - 4 N- p / 2 -\ 



Let v = ^sz. To facilitate the analysis, we will assume that v > 0. By (2.3), 
we have 



N(m F A n (z) - Em F A n (z)) 



N 



NJ2(E 3 - E^ 1 )(3 J (z)s* j Aj\z) W * n Aj 1 (z)s j . 



Since 



Pj(z) = bj(z) - PjWbjizfeiz) = bj(z) - b 2 (z)Cj(z) + tfWPjWtfiz), 
we get 

(Ej - E J . 1 )P J (z)s*Aj 1 (z) W * n Aj l (z)s ] 

= EjbfchM - E j (b 2 j (z)t j (z)±x.lAj 1 (z)T n Aj 1 (z)x, 

+ (Ej - E^ 1 )(b 2 (z)P j (z)^ 2 (z)s*Aj 1 (z) Xn ^ n A- 1 (z) S:j 

-b 2 (z)i 3 {z) l3 (z)). 

Applying (4.2), we obtain 

N 

E 



N J2 Ej (b 2 (z)Cj (z)±x* n Aj\z)T n Aj\z)x n 



3=1 



1 N 

= -Y / E\E J (b 2 j (z)^(z) X lAjHz)T n A-\z)^ n )\ 2 
i=i 

<K^E\Uz)? = 0{N- 1 ), 
which implies that ^/NY:f=iE j (b 2 j (z)£ j (z)] 7 x.lAj\z)T n Aj\z)K n ) '3 0. 
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E 



By (4.2), (4.4) and Holder's inequality, we have 
_ N 

NY,(Ej ~ E j _ 1 )b 2 j (z)P j (z)^(z)s*Aj\z) Xn x* n Aj 1 (z)s J 



3=1 

< K 



= 0(N- 3 / 2 ), 
which implies that 

N 

VNJ2( E 3 - E^ 1 )b 2 J (z)p :i (z)^(z)s*Aj 1 (z) W * n A- 1 (z)s, *S 0. 

Using a similar argument, we have 
_ N 

3=1 

The estimate above (4.3) of [5], (2.17) of [7] and (4.3) collectively yield that 
E\(b j (z) + zm(z)) 7j (z)\ 2 

= E[E(\(b J (z) + zm(z)h j (z)\ 2 \a( Sll i^j))] 



E[\b 3 (z)+zm{z)\'E{\ l3 (z)\ z \a(s l ,i^j))] = o(N- 2 ), 



which gives 



N 



^/Nj2 E M^) + ^m(z)h J (z)] l So. 
j=i 

Note that the above results also hold when Qz < —vo, by symmetry. Hence 
for finite-dimensional convergence, we need only consider the sum 

r N N r 

i=l j=l j=l i=l 

where Yj(zi) = 



Nzim(zi)Ejjj(zi). Since 



we have 

N 



i=i 



Thus condition (ii) of Lemma 3 is satisfied. 



^2aiYj(zi) 



A' 



i=i 



i=l 



o(4). 
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Now, we only need to show that for z±,z 2 6 C \ R, 

N 

(4.5) T, E i~iO r M)YM)) 

3=1 

converges in probability to a constant under the assumptions in (b) or (c). 
It is easy to verify that 

\txE 3 (Af(z l ) W lA^\z l ))T n E j (Af(z 2 )^ n <Af{z 2 )T^ 

(4.6) 

where v\ = ^s{z\) and v 2 = Q(z 2 ). It follows that, for the complex case, 
applying (4.1), (4.5) now becomes 



ziz 2 m(z 1 )rn(z 2 )^^2 Ej^xtv E j (A j 1 (z 1 )yi n yi* n A j l {z 1 ))T n 
i=i 

x E j (Aj\z 2 )xn<A- 1 (z 2 )T n ) + 0p (l) 



(47) 

1 

= z 1 z 2 m(zi)m(z 2 )—^2E j ^ 1 (xlA j 1 (z 1 )T n A j 1 (z 2 )x n ) 
j'=i 

x ( x ;i- 1 (z 2 )r n ^v 1 (z 1 )x n ) + o p (i), 

where Aj 1 (z 2 ) is defined similarly as A~ 1 (z 2 ) by (si, . . . ,Sj_i,s^+i, . . . , Sjv) 
and where Sj+i, . . . , Sjv are i.i.d. copies of Sj+i, . . . , sjv- 

For the real case, (4.5) will be twice the magnitude of (4.7). 

Write 

x^iAfizi) - ^_ 1 AT 1 (z 1 ))T n iT 1 (z 2 )x n 

(4.8) 

N 

= J2<(E t Aj 1 (z 1 ) - E t _ 1 Aj 1 (z 1 ))T n Aj 1 (z 2 )x n . 
t=j 

From (4.8), we note that 

E j ^ 1 (^Aj\z 1 )T n Aj 1 {z 2 )^)(^Aj\z 2 )T n Aj^z 1 )^) 

N 

= Y J E J -iK{EtA]\z l ) - S t _ 1 AT 1 (z 1 ))T„i- 1 (z 2 )x n x;iT 1 ( Z2 ) 

t=j 

x T n {EtAj\zx) - ^_i^7 1 (zi))x n 
(4.9) + ^•_i(x;(^_ 1 ^T 1 ( Zl )r„)i7 1 (z 2 )x ri ) 

x(x;I- 1 (z 2 )T n (^_ 1 A- 1 (z 1 ))x„) 
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= E j ^(E j -lAj 1 (z 1 )T n )Aj 1 (z 2 )^ n ) 

x (^ n A- l (z 2 )T n (E j _ l A- l {z l ))^ n ) + 0{N- 1 ), 
where we have used the fact that 
lEj^UEtAjHz!) - Et-iAj 1 ^)) 

x T n A- 1 {z 2 ) W * n Aj\z 2 )T n (E t Aj 1 {z 1 ) - Et-iAj 1 (zi))x n | 

<4(|^_ 1 |A i (^i)x;(^ 1 (^i)sts t *(^. 1 (^i)r n I- 1 (z 2 )x ri | 2 

x J E j _ 1 |A i (z 1 )x;i- 1 (z 2 )T ri (^- 1 (z 1 )s 4 s t M- 1 (z 1 ))x n | 2 ) 1 / 2 = 0(N~ 2 ). 
Similarly, one can prove that 

^•_ 1 (x;(^_ 1 ^T 1 ( Zl )r n )iT 1 ( Z2 )x„)(x;iT 1 ( Z2 )r ri (^_ 1 ^T 1 ( Zl ))x n ) 
= (x^7 1 (^)r n iT 1 (^ 2 )x n ) 

x ^■„ 1 (x;I- 1 (z 2 )T n ^7 1 (z 1 )x n ) + oiN- 1 ). 

Define 

^•(z) = A(z) -s iS * -s jS *, T~\zi) = (zil ^b n i(zi)T n 

Ba(z) = 1 and b n \ (z) = ? . 

' l + s*A- j 1 (z)s l nn ' l + N^EtiT n A^(z) 

Then (see (2.9) in [7]) 

(4.10) Aj(zi) = -T-\ Zl ) + b nl {z l )B j {z l ) + Cj(zi) + Djizi), 
where B 1 (z 1 ) = B jl (zi) + B j2 (z 1 ), 

B jl (z 1 )=J2T- 1 (zi)(s i s*-N- 1 T n )A^(z 1 ), 

i>j 

B j2 (z 1 )=J2T- 1 (zi)(s t s*-N- 1 T n )A^(z 1 ), 

i<j 

C j {z 1 )=Y J {Pi^ 1 )-b nl (z 1 ))T-Hzi)s l s*AT\z 1 ) 



and 



D j (z 1 ) = N- 1 b nl (z 1 )T- 1 (z 1 )T n Y^(Ar j \z 1 )-A j (z 1 )). 

#3 
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It follows that 

E j . 1 (^Aj\z 1 )T n A-\z 2 )^n)E j . 1 (^A-\z 2 )T n Aj 1 (z 1 ) Xn ) 
= -E j . 1 ^* n Aj 1 (z 1 )T n A- 1 (z 2 )^ n ) 

(4.11) 

x E^ 1 {^ n A j \z 2 )T n T~ 1 (z 1 )T n ^ n ) 
+ B(z u z 2 ) + C( Zl ,z 2 ) + D( Zl ,z 2 ), 

where 

B( Zl ,z 2 ) = b nl (z 1 )E j ^ 1 (^ l Aj 1 (z 1 )T n Aj 1 (z 2 )ic n ) 

x J B J _ 1 ( x ;i- 1 (z 2 )r nJ B j2 (z 1 )x n ), 

C(z 1 ,z 2 )=E j - 1 (x* n Aj 1 (z 1 )T n A- 1 (z 2 )x n ) 

x ^_ 1 (x;i7 1 (^)r n c J -(^ 1 )x n ) 

and 

D(z 1 ,z 2 ) = ^_i(x:A- 1 (z 1 )r n iT 1 ( Z2 )x„)(x;iTi( Z2 )T„Z) j (z 1 )x ri ). 
We then prove that 

(4.12) E\C( Zl ,z 2 )\=o(l) and E\D(z x , z 2 )\ = o(l). 

Note that although C and Z) depend on j implicitly, E?|C(zi, ^2 ) | and E\D(z±, z 2 )\ 
are independent of j since the entries of X n are i.i.d. 
We then have 

E\C( Zl ,z 2 )\ < j-^E\ X * n Aj 1 (z 2 )T n C j (z 1 )^ n \ 

x^ls^r.^zOx^^ij 1 ^))^^ 1 ^)^! 2 ) 1 / 2 . 
When i > j, Sj is independent of Aj 1 (z 2 ). As in the proof of (2.2), we have 

(4.13) E^A^iz^nicU^^TnT^iz^Sil 2 = 0(N~ 2 ). 

When i < j, by substituting Aj l (z 2 ) for A^ l (z 2 ) - fyj (z 2 ) A^ 1 (z 2 )siS* x 
^^ 1 (- z 2)) w e can also obtain the above inequality. Noting that 

(4.14) E\p i:j (z 1 )-b nl (z 1 )\ 2 =E\p ij (z 1 )b nl (z 1 )C lj \ 2 = 0(n- 1 ), 

where Cij( z ) = s*A~. (z)sj — -^tr^4~ 1 (z) and (3ij(z 2 ) is defined similarly to 



Pij{z 2 ), and combining (4.13)-(4.14), we conclude that 

E\C(z 1 ,z 2 )\=o(l). 
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The argument for D(z%,z 2 ) is similar to that of C(z±,Z2), only simpler, and 
is therefore omitted. Hence, (4.12) holds. 
Next, write 

(4.15) B {zi , z 2 ) = Bx (zi , z 2 ) + B 2 {zi , z 2 ) + B 3 (zi , z 2 ) , 

where 

B\{z\,z 2 ) = ^2 Ki(zi)Ej-ix.* l P i j(zi)A~j 1 (zi)s i s*Alj 1 (zi)T n Aj 1 (z 2 )yL n 

x £; i „ 1 x;iT 1 (z 2 )T n T" 1 (z 1 )(s i s* - iV- 1 T n )Ar. 1 (z 1 )x n , 
B 2 (z u z 2 ) = ^6 n i(z 1 )S i _ix;4- 1 (z 1 )r n ir4( Z2 ) Si s*i- 1 (z 2 )A i (z 2 )x n 

i<j 

x ^■_ 1 x;iTi( Z2 )T n T- 1 (z 1 )(s i s* - iV- 1 r n )^. 1 (z 1 )x n 

and 

Bz{zi,z 2 ) = ^b nl (z 1 )E j _ 1 x* n A^ 1 (zi)T n A~ j l (z 2 )x n 

i<j 

x ^•_ 1 x;i- 1 (z 2 )T n r^ 1 (z 1 )(s i s* -iV^ 1 r n )^r. 1 ( Zl )x n . 

Splitting Aj 1 (z 2 ) into the sum of A~^-(z 2 ) and -/3i J (z 2 )^ 1 (2; 2 )sjS*A~ 1 (z 2 ), 
as in the proof of (4.14), one can show that 

<^|6 r a(^i)|(^|x;A,(z 1 )^ 1 (^i)s«sI^ 1 (^i)^i- 1 (^)x n | 2 

i<j 

x S|x;i- 1 (z 2 )T n T^ 1 (zi)(s l s* - Af" 1 T„)Ar. 1 (z 1 ) Xri | 2 ) 1/2 

= o(iv- 1/2 ). 

By the same argument, we have 

E\B 2 (z 1 ,z 2 )\=0(N- 1 ). 

To deal with B 3 (zi,z 2 ), we again split Aj 1 (z 2 ) into the sum of t4~ 1 (z 2 ) 
and -^ J (z 2 )^~ 1 (2: 2 )sjS*A^ 1 (z 2 ). We first show that 

B31 (z l7 z 2 )=Y^ b n i (^i)-Ej-ix*^ 1 (zi )T n Ar 1 (z 2 )x n 

i<j 

(4.16) x ^_ 1 x;i-. 1 (z 2 )r n T- 1 (z 1 )(s l s* - iV- 1 T n ) J 4- 1 (z 1 )x r 

= o„(l). 
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We have 

E\B 31 ( Zl ,z 2 )\ 2 = \b n i(zi)\ 2 EE^Ar)( Zl )T n A-)(z 2 )x n 

x Ej.^Ar] (z!)T n A^ (z 2 )x n 
x E j ^A- 1 j (z 2 )T n T- 1 (z 1 ) 

x ( Sil si -iV- 1 r n )A-;.( 2l )x nX ;i-J.(2 2 ) 

x T n T -1 (fi)(sj 2 s* 2 - iV- 1 r n )Ari(^ 1 )x n . 
When %\ = i 2 , the term in the above expression is bounded by 

KE\ X * n Ar]( Z2 )T n T~ 1 (z 1 )(s ll sl - N~ l T n )A^( Zl ) Xn \ 2 = 0{N~ 2 ). 
For i\ 7^ i 2 < j, define 

1 



Aixi2j{ z l) = A(z±) — SjjS^ — Sj 2 Sj 2 — SjSj 

and similarly define $i x ,i 2 ,j(z 2 ) and Ai 1 i 2 j{z 2 ). 
We have 

I EE j-l< A Tr,n,j (*1 >*2 i^ki 1*2 ,j (*l • (^ 2 ) 
x x^-ix^ri (zx)T n i- } (z 2 )x n 

x ^•_ 1 x;i-J(z 2 )r n r- 1 (z 1 )(s il s* 1 - a^t^-J^iK 
x x ;i- J 1 (z 2 )r n r- 1 (z 1 )(s. i2 s* 2 - N-^A-p^i 

<K(E\xlA-] i2tj ( Zl )s i2 slAr^ 

x {E\^A- 2 ){z 2 )T n T-\ Zl ){ Sl2 sl - N^TjArfa)**] 4 ) 1 ' 4 
= 0(iV- 5 / 2 ), 

x ^-ix^ArJ (z!)r n i- J (z 2 )x n 

x E 3 ^ n Ai i )( Z2 )T n T-\ Zl ){s ll s* il -N-^AT^zx)^ 

x x;ir}(l 2 )T n T- 1 (f 1 )(s i2 s* - AT- 1 T n )^(f 1 )x n | 
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<K{E\^Ar i ] i2 .{z l )T n A-) i2tj ^ 

x (E\^ n A-}(z 2 )T n T- 1 (z 1 )(s t2 s* 2 - N-^A^MWl*) 1 ' 4 
= 0(iV- 5 / 2 ) 
and, by (4.1), 

|i^-lx;A r i,i(.^ 

x(s n s* i -iv- 1 r ri ) 

x yl- u 1 (z 1 )x n x;iri(^)7:„r- 1 (z 1 )(s J2 s* 2 - at- 1 ^)^.^)^! 

<^(^|x;i-;. 2J (z 2 )s J2 s* 2 i-^ ii (z 2 )A 1 , J2J (^)^r- 1 (z 1 ) 

x(s ll s* i -iv- 1 r n K^(^iKI 2 ) 



2\l/2 



x (i?|x;i-J(z 2 )r n r- 1 (^)(s J2 s: 2 - at-^a-^ki 2 ) 1 / 2 

<^(^l<^i 2 ,i(%)s i2 s* 2 iri 2) .( 22 )T n T- 1 (^i) 

x ( Sil s* - N^T^A-^z^ 2 ) 1 ' 2 x O^ 1 ) 
^^(^ir^^^^s^s^i-^^z,)^-^^)^^^^)^ 

x A iL J s* i-) i2 j {^wlA-y (z! )T n A~) ( Zl )x re )V 2 
x 0(iV~ 2 ) 

<^( J E|x;I-;. 2j (z 2 )s l2 S* 2 i-; i2ii (z 2 )x n | 2 ) 1 /4 

x (£| s * 2 ir^ 2 ^^ 

x 0(iV- 2 ) 

= 0(AT-9/ 4 ). 

The conclusion (4.16) then follows from the above three estimates. 
Therefore, 

83(21,22) = B 32 (zi,z 2 ) + o p (l), 

£32(21,22) = -^2b n i(zi)E j ^ 1 x* n Aj j 1 (zi)T n A^ j 1 (z 2 )x n 



i<3 

xE^^lA^iz^A^iz^^iz^TnT- 1 ^) 
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x (s i s*-Af- 1 T n )^r. 1 ( Zl )x n 
= "E *»1 (^Ej-lKA^ 1 (Z! )T n A"- 1 (z 2 )x n 

x s i s*^ 1 (2i)x n + o p (l). 
By (4.3) of [5], (4.2) and (4.4), for i <j, we have 

E\ X lA^(z 2 )s i s*A^(z 1 ) Xn (s*A^(z 2 )^(z 2 )T n T-\z 1 )s l 

-N- 1 b nl (z2)tTT n Ar j l ( Z2 )T n T- 1 (zi))\ 

<{E\^A-l{z 2 ) S ^ATl( Zl )^ 

(4.17) x [(E\p ij (z 2 )\ 2 \ S *A^(z 2 )T n T- 1 (z 1 )s i 

- N- 1 trT n Ar j 1 (z 2 )T n T- 1 (z 1 )\ 2 ) 1/2 

+ (S|4'(^) - 6 n i(z 2 )| 2 |Af- 1 trT n ,Ir 1 ( Z2 )T n T- 1 (z 1 )| 2 ) 1/2 ] 

= o(iv- 3 / 2 ). 

Collecting the proofs from (4.10) to (4.17), we have proved that 
B(z 1 ,z 2 ) = -b nl (z 1 )b nl (z 2 ) 

x £ ^•„ 1 x;Ar. 1 (z 1 )T n I- 1 (z 2 )x nJ B^ 1 

x ( X lA^\z 2 )s l s*Ar j l (z 1 ) Xn N- 1 tiT n trT n A^\z 2 )T n T~\z 1 )) 

+ Op(l). 

Similarly to the proof of (4.16), we may further replace s^s* in the above 
expression by N~ l T n , that is, 

B(z 1 ,z 2 ) = -b nl (z 1 )b nl (z 2 )N- 2 

x £ £; i _ 1 <A-. 1 (z 1 )r n Ir. 1 (^)x n ^_ 1 

i<j 

x (x;i- 1 (z 2 )T n 4^( Zl ) Xn trT n i- 1 (z 2 )T n T- 1 (z 1 )) + o p (l). 

Reversing the above procedure, one finds that we may also replace A^ (z\) 
and A^ (z 2 ) in B(zi,z 2 ) by Aj 1 (zi) and A~ 1 (z 2 ), respectively. That is, 

r>, \ Kl{zi)b nl {z 2 ){j - 1) * ,1-1/ \rr-i x-i/- ^ f 

^(21,22) = ^ ^-l*^' (^l)In^ 1 (z 2 )x n E j _i 

x (^ l Aj 1 (z 2 )T n Aj 1 {z 1 )yi n tvT n Aj 1 (z 2 )T n T- 1 {z 1 )) + o p (l). 
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Using the martingale decomposition (4.8), one can further show that 

\ b n i{zi)b nl {z 2 )(j -1) * A -lf w a-1( \ 

B(z 1 ,z 2 ) = ^ E i-i x n A j {zi)T n A j (z 2 )x n 

xE j ^ n Aj 1 {z 2 )T n Aj 1 (zx)^ n E j _ 1 trT n Aj 1 (z 2 )T n T- 1 (zx) 

+ Op(l). 

It is easy to verify that 

Ar- 1 tr(r re M( 22 )r n r- 1 (^ 1 )) = 0p (i) 

when M{z 2 ) takes the value Bj(z 2 ), Cj{z 2 ) or Dj(z 2 ). Thus, substituting the 
decomposition (4.10) for Aj 1 (z 2 ) in the above approximation for B(zx,z 2 ), 
one finds that 

r> / \ b n l(zi)b n l(z 2 )(J ~ 1) yp^-l/ s 

B{Zl,Z 2 ) = — ^ £Jj_lX n ^ («i)T n ^ (^)x n 

(4.18) x ^_ 1 x;I- 1 (0 2 )T re A- 1 (^)x n 

x ^_ 1 trT n r- 1 (0 2 )T n T- 1 ( 2 ;i) + o p (l). 

Finally, let us consider the first term of (4.11). Using the expression for 
Aj 1 (z 1 ) in (4.10), we obtain 

-^_ix^T 1 ( Zl )r„i- 1 (z 2 )x n ^_ 1 x;iT 1 ( 22 )r n r- 1 (^i)x ri 

(4.19) 

= W 1 (z 1 ,z 2 ) + W 2 (z 1 ,z 2 ) + W 3 (z 1 ,z 2 )+W 4 (z 1 ,z 2 ), 

where 

^ 1 (z 1 ,z 2 ) = ^_ix;r- 1 (z 1 )T n i7 1 (2 2 )x n ^ i _ 1 x;i7 1 (z 2 )T n T- 1 (^i)x n , 

W 2 ( Zl ,z 2 ) = -6 n i(zi) J E J _ 1 x; J B~ 2 1 (zi)T n i- 1 (z 2 )x n 

x Ej^Afiz^TnT-^zx)^, 

W 3 (zx,z 2 ) = -E j _x<Cr\z 1 )T n Aj 1 {z 2 )x n E j _ 1 ^Aj\z 2 )T n T- 1 (zx)x n 
and 

W4(^i^2) = -^-ix;^7H^i)r n ir 1 ( Z2 )x^ i _ 1 x;Ir 1 ( Z2 )r„r- 1 ( 2l )x n . 

By the same argument as (4.12), one can obtain 

(4.20) E\W 3 (zx,z 2 )\ = o(l) and £|W4(*i,z 2 )| = o(l). 

Furthermore, as in dealing with S(2i,z 2 ), the first A~ 1 (z 2 ) in W 2 (z\,z 2 ) 
can be replaced by -6 n i(z 2 )^ 1 (z 2 )sjS* J 4~ 1 (z 2 ), that is, 

W 2 (zx,z 2 ) 
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= b n i{zi)b n i(z 2 ) 

xJ2E J - 1 KT- 1 (z 1 )( Sl s* - N- l T n )Ar\ Zl )T n 

i<j 

x A- j i {z 2 )s t s*AT j 1 (z 2 )x n E j ^* n A- 1 {z 2 )T n T- 1 {z 1 )x n + o p (l) 
= b n i(zi)b nl (z 2 ) 

x J2E j -i<T-\z 1 )s i s*Ar j 1 (z 1 )T n 

i<j 

x I- 1 (^)s i s*i-. 1 (z 2 )x n ^_ 1 x;i- 1 (^)T„T^ 1 (z 1 )x n + Op(l) 

= bnl(^l)^nl(^2)(j ~ 1) 

x^_ 1 (x;r" 1 (^i)7;i7 1 (z 2 )x n trr n ,47 1 (^i)rni7 1 (^)) 

x ^_ 1 x;i- 1 (z 2 )T n T- 1 (2i)x n + o p (l). 
It can also be verified that 

X * n M(z 2 )T n T~\ Zl )x n = o p (l), 

when M(z 2 ) takes the value Bj(z 2 ), Cj(z 2 ) or Dj(z 2 ). Therefore, W 2 {z\,z 2 ) 
can be further approximated by 

tt r / \ Ki(zi)b n i(z 2 )(j - 1) , x , . , 2 

^2(^1,^2) = ( X « T (^l) T nr X (2: 2 )x n f 

(4.21) x E j _ 1 tv(T n Aj 1 (z 1 )T n A- 1 (z 2 )) + o p (l). 

In (2.18) of [7], it is proved that 

E j _ 1 tT(T n Aj 1 {z 1 )T n Aj 1 (z 2 )) 

= tr(T n r- 1 (^i)r n r- 1 (^)) + o P (i) 

1 - (j - l)/N 2 z 1 z 2 m(z 1 )m(z 2 )tv(T n T- 1 (z 1 )T n T- 1 (z 2 )- 
By the same method, Wi(z\,z 2 ) can be approximated by 

w 1 (z 1 ,z 2 ) = x;T- 1 (z 1 )T n r- 1 (^)x n x;r- 1 (z 2 )^T- 1 (z 1 )x n + 0p (i). 

(4.22) 

Consequently, from (4.11)-(4.22), we obtain 

^_ix;AT 1 (z 1 )T n 4-(A- 1 (z 2 )x n ^_ 1 x;i- 1 (z 2 ))T n A- 1 (z 1 )x n 

l- 3 -^b nl {z l )b nl {z 2 ) — trT- 1 {z 2 )T n T- 1 {zi)T n 



(4.23) 



iCj'-\z l )T n T-\z 2 )x r X n T-\z 2 )T n T- l {z 1 )x r 
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x (l + J ^j^b nl (z 1 )b nl {z 2 )-E j ^ l tr(Aj\z 1 )T n Aj 1 (z 2 )T n ) 

+ Op(l). 

Recall that b n i(z) — > —zm(z) and F Tn — > H. Hence, 

d(z u z 2 ) ■■=^b nl (z 1 )b nl (z 2 ) — tr(T- 1 (z 1 )T n T- 1 (z 2 )T n ) 



(4.24) 



ct 2 m(zi)m(z 2 ) 



1 + 



(l + tm( Zl ))(l+tm(z 2 )) 
m(z 1 )m(z 2 )(z 1 - z 2 ) 



dH(t) 



m(z 2 ) — m(zi) 
By the conditions of Theorem 2, 

h{z\,z 2 ) = lim ziz 2 m(z 1 )m(z 2 )x* n T~ 1 (z 1 )T n T~ 1 (z 2 )x r: 
xx;T- 1 (z 2 )T n T- 1 (zi)x n 



(4.25) 



m(zi)m(z 2 ) / f t 2 m(zi)m(z 2 ) 



z\z 2 



\J (l + tm(zi))(l+tm(z 2 )) 
tdH(t) 



dH{t) 



m(zi)m(z 2 ) ( 

z^z 2 V (^ + tm(z 1 )){l + tm{z 2 )) 

m(zi)m(z 2 ) ( zim(zi) - z 2 m(z 2 )\ 2 



z\z 2 



V {m{z 2 ) -m(zi)) ) 



From (4.10), (4.24) and (4.25), we get 
-i ! 



(4.7) ^h(z u z 2 ) 
h(zi,z 2 ) 



o (1 - td(zi,z 2 )) 



dt + 



td(zi,z 2 ) 



o (l-td(z u z 2 )) 2 



dt 



(z 2 m(z 2 ) - zim{zi)f 



1 - d(zi,z 2 ) c 2 z 1 z 2 (z 2 - zi)(rn(z 2 ) -m(zi))' 

5. Tightness of M^(z) and convergence of M^(z). First, we proceed 
to the proof of the tightness of M^(z). By (4.3), we obtain 



E 



N 



J2 a iJ2 Y i( Z i) 
i=l j=l 



N 



-EE 



^2aiYj(zi) 



i=l 



< K. 



Thus, as pointed out in [7], condition (i) of Theorem 12.3 of [8] is satisfied. 
Therefore, to complete the proof of tightness, we only need verify that 



(5.1) 



\Z\ - Z 2 \ 
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Write 

Q(z 1 ,z 2 ) = \/Nx n (A n - zJ)- l (A n - z 2 I)~ 1 x n - 

Recalling the definition of M*, we have 

\M^ Zl )-M^z 2 )\ 
\z± - z 2 \ 

'\Q{ Zl ,z 2 )-EQ( Zl ,z 2 )l 
if zi,z 2 eC UC , 
< ( \Q(z 1 ,z 2 +) -EQ(z!,z 2+ )\ + \Q(zi,z 2 -) - EQ(zi,z 2 -)\, 
if z\ € Co U Co only, 
|Q(z+,z_)-£Q(z+,z_)|, 
otherwise, 

where 3l(z 2 ±) = $iz 2 , Q(z 2 ±) = ±<5 n ra _1 , = ±<5 n ,re _1 and $t(z±) = or 

u r . Thus we need only to show (5.1) when z±,z 2 G Co UCo- 
From the identity above (3.7) in [7], we obtain 

M " (Z1) I M " (Z2) = VnY,(e s - e^ka-HzJa-Hk)** 

z\ z 2 

(5.2) 

= Vi(z 1 ,z 2 ) + V 2 (zi,z 2 ) + V 3 (zi,z 2 ), 

where 

_ N 

V 1 {z 1 ,z 2 ) = ^N^ E J - E ^)l 3 M)l 3 j( z 2>jAj 1 (z 1 )Aj\ Z2 ) Sj s* 

3=1 

x Aj l {z 2 )y^K* n A- 1 {z 1 )s j , 

_ N 

V 2 {z u z 2 ) = v^V]T(£, ~ ^-i)^^i)s^7 1 (^i)^7 1 (^)x n x^- 1 (^i)s j 
j'=i 

and 

AT 

V^i,z 2 ) = VN^Ej - E j . l )P j {z 2 ) S *A-\z 2 ) W * n A]\z l )A:\z 2 )s j . 

3=1 

Applying (3.1) and the bounds for 0j{z) and s|A~ 1 (zi) J 4~ 1 (z2)sj given 
in the remark concerning (3.2) in [7], we obtain 

N 

E\V! (zi, z 2 )\ 2 = N ]T E\ (Ej - E^Pj (zi)(3j(z 2 )s*Aj 1 ( Zl ) 

3=1 

x Aj 1 {z 2 )s j s* j Aj x {z 2 )x n yi* n x A~ 1 {z l )s j \ 2 
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(5.3) < KN 2 (E\s*Aj 1 (z 2 )w*nAj 1 (z 1 )s j \ 2 

+ v' 12 n 2 P(\\A 1 \\ >u r or A^<«,)) 

<K, 

where (1.9a) and (1.9b) in [7] are also employed. It is easy to see that (1.9a) 
and (1.9b) in [7] also hold under our truncation case. Similarly, the above 
argument can also be used to treat V2{z\,z 2 ) and V%(zi, z 2 )- Therefore, we 
have completed the proof of (5.1). 

Next, we will consider the convergence of M 2 (z). Note that 

If 1 

(5.4) m F cn,n n (z) = — / — — -—dH n (t). 

zj l + tm F c n ,H n (z) 

Substituting (2.5) into (5.4), we obtain that 
zVN ((x^A -1 )^)^ - m FCn ,H n (z))) 

(5.5) = VNU* n {-Em n (z)T n - /)" 1 x n + / - - 1 — dH n (t) 

\ J 1 + tm F c„,H n (z) 

+ VNz{5i + 5 2 + S 3 ). 
Applying (2.6)-(2.8), we have 

VNz(5 1 + 5 2 + 5 3 ) = o(1). 
On the other hand, in Section 4 of [7], it is proved that 

(5.6) sup a/JV (m F c n ,H„ (z) - Em n (z)) — > 0. 

z 

Following a similar line to (4.3) of [7], along with (4.2) of [7], we can obtain 
sup \\(m FCn ,H n (z)T n + I)" 1 1| < oo. 

n,zgCo 

It follows, via (4.3) of [7] and the assumption of Theorem 2, that 

(5.7) sup / --^ rdH n (t) < co. 

n,z<LC J {I + tm F c n ,H n {z))(tEm n (z) + 1) 

Appealing to (4.1), (4.3) in [7], (5.6) and (5.7), we conclude that 
VN^ n ( Emn (z)T n + - / Em 2 z)t + l dH n (t)] 

= VN( X * n (m Fcn , Hn (z)T n + iy 1 Xn - f 1 dH n (t)) +o(l). 

\ J m F c„,H„ (z)t +1 / 
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Using (5.6) and (5.7), we also have 

W ruTT ^)- / i if 1 TT^n(t) 

\J Ern n (z)t + 1 J 1 + tm F c n ,H n (z) 



= VN {m F c n ,H n (z) - Em n (z)) [ —— \ <*H»(t) 

7 (1 + tm F c n ,H n {z)){tEm n {z) + 1) 

= o(l). 

Combining the above arguments, we can conclude that 

(5.5) ^0. 

6. Proof of Theorem 3 and supplement to Remark 7. In this section, 
when T n = I, we will show that formula (1.12) includes (1.2) of [15] as a 
special case and we will also present a proof of (1.14). 

First, one can easily verify that (1.15) reduces to (1.2) of [15] when g(x) = 
x r . Next, our goal is to prove that (1.12) implies (1.14) under the condition 
of Theorem 3. 

Write 

(z 2 m(z 2 ) - zim(zi)) 2 = ziz 2 (m(zi) - m(z 2 )) 2 + m(zi)m(z 2 )(z 2 - z\) 2 
(6.1) + z 2 m(z 2 )(z 2 - z 1 )(m(z 2 ) - m(zi)) 

+ zim.(z 1 )(z 2 - zi){m(z 2 ) - m(zi)). 

Recall that 

^ ^ m(z) I 1 + tm(z) ^ ^' 

from which [together with assumption (1.13)] we obtain 
m(zi)m{z 2 ){z 2 - zi) f t 2 m(zi)m(z 2 ) dH(t) 



rn{z 2 ) - m(zi) J (1 + tm(zi))(l + tm(z 2 )) 

f tm(zi) , s f tm(z 2 ) 
= 1 " c / ; , \ dH(t) / - — V 2 / . dH(t) 
J l + tm( Zl ) y 'J l + tm(z 2 ) v ' 

= 1 - c _1 (l + zim(zi))(l + z 2 m(z 2 )). 

Replacing one copy of z 2 — z\ by this in the second term on the right-hand 
side of (6.1), we obtain 

(z 2 m(z 2 ) - z 1 m(zi)) 2 

(6.3) 



z 1 z 2 (m(zi) -m(z 2 )) 2 



+ (z 2 - zi)(m(z 2 ) -m(zi))[(l - c + z\m{z\) + z 2 m(z 2 )) 

- c~ x z\z 2 m{z\)m{z 2 )\. 
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Using this and the facts that (1), (2), (3), we obtain RHS 

1 / -i / \ , fofO), if C encloses the origin, 
2m Jc 10, otherwise, 

— I m{z)g(z)dz = - [ g(x)dF c ' H (x), 
2m Jc J 



Iff m(zo) — m(z\ ) , . . . f , . „ . ,„„w, x 

^ 91 {z l )g 2 {z 2 )dz l dz 2 = / 9i(x) 52 (x)dZ c ' H (x), 



47T 2 Jci /C 2 ^2 - Zl 

when Cj enclose the origin, we obtain 
RHS of (1.12) 

= |/ 9i(*)92(*)dF c < H (x) 



-92(0) j gi (x)dF c > H (x] 
f 9 i(x)dF c > H (x) Jg 2 (x)dF c > H (x) 



= -(j gi {x)g 2 {x)dF c > H (x)- j 9l {x)dF c > H {x) J g 2 {x) dF c,H (x) 

The same we can obtain when Cj does not enclose the origin, we can obtain 
the same result even more easily. 
Thus the result is proved. 

7. Truncation, recentralization and renormalization of Xij. In this sec- 
tion, to facilitate the analysis in the other sections, the underlying random 
variables need to be truncated, recentralized and renormalized. Since the 
argument for (1.8) in [7] can be carried directly over to the present case, we 
can then select e n such that 



(7.1) £n^0 and e" 4 / |X n | 4 ^0. 

Al^nl>£»" 1/4 } 

Let Xij = XijIdXijl < e n n l ' A ) - EXijI(\Xij\ < e n n l ' A ), X n = X n - X n , 
and A n = iT n 1/2 X n i^T n 1/2 , where X n = (Xij). Let a 2 n = E\Xu\ 2 and A n = 
j^T^XnX*^ 2 . Write A~ l {z) = (^-z/)" 1 and A~ 1 (z) = (A n -zI)-\ 
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Lemma 4. Suppose that Xij 6 C, i = 1, . . . ,n,j = 1, . . . , N, are i.i.d. with 
EXu = 0,E\Xn\ 2 = 1 and E\Xu\ A < oo. For z G Co, we then have 

(7.2) v/iVx^i-^K - x;^- 1 (^))x n l 4' 0. 

Proof. Corresponding to the truncated and renormalized variables, we 
similarly define sj, Sj, A~ 1 (z), A~ 1 (z), $j(z), Pj 1 j 2 (z) and (3j 2 ji( z )- 
We then have 



iv( x ;i- 1 (z)x n -x;^- 1 (z)x n ) 

]={^A-\z)Ty\X n - X n )X* n T^A-\z)^ n 
+ ^-Hz)T^X n (X* n -X* n )T^A- 1 (z) Xn ) 

_ N N 

(7.3) = ViV^x;i- 1 (2)s J s*A- 1 (z)x n + VNj2< A ^( z ) g j g *j A ' l ( z ) x ri 

3=1 3=1 
N 



3=1 

N 

+ VN^P j (z)x* n Aj\z)s :j s* j A- 1 (z)yL n 

3=1 

A 

= Ul +L0 2 . 

Consider first the term uj\. 

N 

E\u;i\ 2 < N^m^K^i^jAjH^nl 2 

3=1 

+ iV £ \E(3 n (z) X * n A- 1 (z)s n s* i Aj i 1 (z) Xn 

,31 7^2 

(7-4) 

x Pj2{z)<A j2 1 {z)s j2 s* 2 A 1 (z)x n | 

A 

= Uu +LU 12 , 

where f3j 2 (z) is the complex conjugate of (3j 2 (z). 

Our next goal is to show that the above two terms converge to zero for 
all z €C U and z £ C\ when U[ < 0. 

In this case, (3i{z) is bounded. It is straightforward to verify that 

|2 



ElP^z^AjHzys^Aj 1 ^)^ 

< K^|s*,4- 1 (z)x n x;iT 1 (z)s i | 2 = o(N~ 
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(7-5) 

E\iT j Aj 1 (z)B j -E(X 11 X^)N- 1 ttAj\z)T n \ i = o{N- 2 ), 
E\ S *Aj x {z)^ n A: 1 {zr Sj \ A = 0(N~ 3 ). 
Therefore, 

E\P j (z)P j (z) X lAjHz)s j s* j AjHzys j s*AjHz)^n\ 2 

< K(E\s* j Aj 1 (z)s j - EiXnX^N-HrAf^TX)^ 2 
x{E\ S *Aj\z)^ n AT l {z)sA A ) 1 ' 2 

+ ^|X 11 | 2 I(|X 11 |>e n n 1 / 4 ) J B|s^- 1 (z)x n x;i- 1 (^)s j | 2 = o(^ 2 ). 

It then follows that 

N 

3=1 

(7.6) +E\p j (z)^Aj 1 (zy SjS *Aj 1 (z)^ n \ 2 ) 
= o(l). 

Now consider the term toi2- We have 
= Ai + A 2 + A 3 + A 4 , 

where 

Ai = E(3 n (z)P ja (z)P h (z)0 h {z)s* h AT 1 (z)x„x;A- 1 (z)s n s* 2 It 1 (z)s h 
A 2 = -S/3 il (z)/3 J2 (z)4(z)s* i ^T i 1 ( z )x„x^T 2 1 (z)s i2 

x ^ i 7 2 1 (^)% 2 ^ 2 ^7 2 1 (^)xnx;i- 1 (^)s il , 

A 3 = -E0 h {z)f3 n (z)p h (z)4 AT 1 (z) Xn x^T 1 (z) Sj2 s* 2 iT 1 (f ) Xn 

A 4 = ^ (z)/? j2 (z)s* i AT i 1 ( z )x n x^-/(z)s j2 s J \iT 1 (z)x n x;iv 1 (z)s il . 

In the sequel, Ai will be further decomposed. However, since the expan- 
sions of Ai are rather complicated, as an illustration, we only present esti- 
mates for some typical terms; other terms can be estimated similarly. The 
main technique is to extract the jith and j 2 th column, respectively, from 
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T,\ /2 X n of Aj 2 \z) and Aj*(z), and so on. We will evaluate the following 
terms of Ai: 

An, A12, A13, A14. 

Their definitions will be given below, when the corresponding terms are eval- 
uated. 

Define 

Vi = s* 1 Aj_ j S j 2 (z)^. n x^ l Aj_ j S j 2 (z)sj 2 , 
V * = s* j2 A-) 2 (z)sn ~ EiXnX^N" 1 tr A^(z)T n , 
V 2 = s* 2 ijj 2 (z)x n x;ijj 2 (z) Sjl , 
V * = ^AjiMsn ~ EiXnX^N" 1 tr A~^{z)T n . 
One can then easily prove that 

E\V 3 f = o(N- 1 ), E\V A \ 2 = o(N- 1 ), 

(7.7) 

^|y 1 | 4 = 0(iV- 4 ) and E\V 2 \ 4 = 0(N- 4 ). 
Using (7.7) and (7.1), we obtain 

I An I = W h {z)f3 j2 (z)$ h (z)P n (z) S * h A-) 2 (z) w * n A:\ 2 (z)s h 

x s h A jij2 ( z ) s h B h A hh ( z "> XnX n A jij2 ( z "> s h s *ji A jij2 ( z ) s ii] I 
< K [E\ Vi 1 4 ] 4 / 4 [E\ V 2 1 4 ] x / 4 [E\ V 3 V A 1 2 ] x / 2 

+ ^|X 1 i| 2 /(|Xii|>e n n 1 / 4 )^|Vl| 4 ] 1 / 4 [ J E|V 2 | 4 ] 1 / 4 [ J E|V- 3 | 2 ] 1/2 
+ KE\Xn\ 2 I(\X u \ > e n n l ' A )[E\ V^'^V^I^V^ 2 
+ K(E\X 11 \ 2 I(\X u \>e n n 1 / 4 )) 2 

x [^Is^^-^^x^^i-^z)^! 2 ] 1 / 2 

x [S|s* 2 i74(^)x n x^7i(^) s ^| 2 ] 1/2 
= (iV- 3 ), 

where we make use of the independence between s*j 2 Aj^j 2 (z)sj 2 and Sj 1 Aj^j 2 (z)sj 1 
when Aj j (z) is given. 



Let 



V 5 = 8i 2 ^i(2)^<4ii a (2)SilSi 1 ^i,i 9 («)Si 
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Similarly, we have 

(7.8) E\V 5 \ 4 = 0(N~ 4 ), 

E\s* 2 Al) 2 {z)^ n Al) 2 {z)s n \ 2 = 0(N' 2 ). 
Consequently, by (7.5), (7.7), (7.8) and (7.1), we have 
I Ai 2 1 = \E[fi h (z)f3 j2 (z)(3 j2jl (z)P h (z)P j2 (z)s* h Aj^ (z)s j2 s* 2 Aj^ (z)x n 

x x *^jij2 ^) s i2 g j 2 ^iii 2 (^)%2 

x *h A hh (z)*n<A-) 2 (z)s h s* n At) 2 (z)s n } | 

< K[E\s^A^{z)x^A^{z^W x imn\ 4 ] 1/A x [E\V^ 
+ KE\X U \ 2 I(\X U \ > e n nV4)^| s * 2 ^ 2 ( z )x n x^-; 2 (z)s i2 | 2 ] 1/2 

x ^|y 4 | 4 ] 1/4 [^|F 5 | 4 ] 1/4 
+ KE\X u \ 2 I{\X u \>e n n l l')[E\s* 2 Al) 2 {z) W ^^^^ 

x [£|y 3 | 4 ] 1/4 [i^l 4 ] 1/4 

+ K(E\X ll \ 2 I(\X ll \>e n n l l i )f[E\s* 2 A^ 
= (iV- 3 ). 

Let Vq = s| 2 ^^ 2 (^)x n x*A^^ 2 (^)s :7 - 1 s| 1 ^^ 2 (z)sj 2 . By Lemma 1, one can 
obtain E\V & \ 2 = 0{N~ 3 ). Hence, 

|Ai3| = |£[M*)& a (*)^ 

x 4^7il2(^ x -<^2(^ s ^4^7 1 ^^ s i2^ i 7 i ; 2 (^)%2 

X ^2^jli2^) XnX ™^jli2( Z )^'l^l^jlj2( Z )^'l]l 

< iq£|y 6 |Y /2 [£|W 4 | 4 ] 1/4 x [e\v^] 1/a 

+ KE\X 11 \ 2 I(\X 11 \>e n n 1 / 4 )K[E\V 6 \ 2 ] 1 / 2 [E\V 4 \ 4 ] 1 / i x [£|V5| 4 ] 1/4 
+ KE\X 11 \ 2 I(\X 11 \>e n n 1 / 4 )[E\V 6 \ 2 ] 1 / 2 [E\V 3 \ 4 ] 1 / 4 x [£|y 5 | 4 ] 1/4 
+ J^|X 11 | 2 /(|X 11 |>enn 1 / 4 )) 2 

x[S|%| 2 ] 1 / a [S|V 3 | 4 ] 1 /*[JS|8^^(^|*] 1 /* 
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Before proceeding, we need the following estimate: 
(7.9) ^|s;^(z)s g s;i M 1 (z)x n x;i M 1 (z)s (? s*i; (? 1 (z)s p | 4 = 0(N~ 
For Py^q, write 

{z)~x. n x. n A pq {z)T r J = (b m i), 



Then 



E\s p A pq (z)s q s p A pq (z)x n x n A pq (z)s q s q A pq (z)s p \ 
1 



AT12 



x ^ Y «ip yi -«2P vi -M3p yi -M4P vl «i'J^i;2? ^g^^g 
(7.10) X 

^mi/i ^m2h bm^ls ^m^l^ 
X Ci 1 j 1 Ci 2 j 2 Ci 3 j 3 Ci i j i 

v Y Y* Y Y* Y* Y Y* Y 

where the summations run over all indices except p and q, and where X* 
denotes the complex conjugate and transpose of X uip , that is, the inter- 
crossed element of the with row and pth column of matrix X n . Observe 
that: 

(1) none of the indices of the above twenty-four random variables appear 
alone, otherwise the expectation is zero, 

(2) tr(Aj 1 (z)T n A pq l (z)T n ) = 0(N) and \X. P \ < e n n 1/4 ; 

(3) |x* A pq (z)T n A pq (z)x. n \ is bounded. Combining the above, we obtain 
(7.9). 

Similarly to (7.9), one can also verify that 
and that 

(7.12) Sls^^^s^^iT^^s^l^O^- 2 ). 
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It follows that 

I A i4 | = \E[f3 n (z)f3 n (z)P Jin (z)P j2jl (z)$ jl (z)$ ja {z)0 nn {z)?CPhh ( z )f 
x s ii A jih ( z ) s i2 s % A jij2 ( z ) x « x n J 4j 1 j 2 ( z ) s ji s ii A jln ( z ) 
x s j2 s* 2 A jij2 (z)s jl s* ji A ji 1 h (z)s h s* h A jih (z)s h s* h A hh (z)x n 

x x «^iii2 ( z )%2^ 2 ^ 1 j 2 ( z )^ji^*ji^-jij 2 ( z )^h^*j2 A jij 2 ( z )^hl\ 
KKiE^A-^z)*^^ 
x [E\slA-) 2 (z)s j2 s* 2 Aj^ 

= o(iV- 3 ). 

All other terms of Ax can be dealt with in a similar manner. Hence, com- 
bining the above arguments, one can conclude that 

n £ ! Ai -> 0. 

Similarly, one can also prove that n^j^ A 2 , nJ2j 17 kj 2 A3 and nX^^ A4 
converge to zero. Hence, — > 0. Combining this with (7.6), we have 

i.p. 
ui — ► 0. 

Using the same method, one can prove that C02 converges to zero in prob- 
ability. Hence, we complete the truncation and centralization of Xij. The 
rescaling of random variables Xy can be completed in a similar way. By 
Theorem 1 in [2], we have 

liminf min(u r — A m ^ x , A m " n — u{) > a.s. 

and 

lim inf min(u r - A^" x , A^™ - u\) > a.s. 

n — >oo 

Hence, for z £ Ci,ui > or z £ C r , we can also proceed with the truncation, 
centralization and rescaling of Xij by the above method. Thus the proof is 
complete. □ 
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